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Abstract 

" , ' Convexity properties of error rates of a class of decoders, including the ML/min-distance one as a 

O : sped case, are studted for arbitrary constellations, bit mapptng and codtng. Earlter results obtained for 

5_i , the AWGN channel are extended to a wide class of noise densities, including unimodal and spherically- 
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invariant noise. Under these broad conditions, symbol and bit error rates are shown to be convex functions 

of the SNR in the high-SNR regime with an explicitly-determined threshold, which depends only on the 

f^ I constellation dimensionality and minimum distance, thus enabling an application of the powerful tools 

of convex optimization to such digital communication systems in a rigorous way. It is the decreasing 

nature of the noise power density around the decision region boundaries that insures the convexity of 

CJ ' symbol error rates in the general case. The known high/low SNR bounds of the convexity/concavity 

regions are tightened and no further improvement is shown to be possible in general. The high SNR 

^ , bound fits closely into the channel coding theorem: all codes, including capacity-achieving ones, whose 
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f— ^ ■ decision regions include the hardened noise spheres (from the noise sphere hardening argument in the 
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channel coding theorem) satisfies this high SNR requirement and thus has convex error rates in both SNR 



■T-H I and noise power We conjecture that all capacity-achieving codes have convex error rates. Convexity 

^■"^ properties in signal amplitude and noise power are also investigated. Some applications of the results 



are discussed. In particular, it is shown that fading is convexity-preserving and is never good in low 
dimensions under spherically-invariant noise, which may also include any linear diversity combining. 
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I. Introduction 

Convexity properties play a well-known and important role in optimization problems [Il|[l2l: it 
is essentially the class of convex problems that are solvable numerically. Furthermore, significant 
analytical insights are available for this class, which cannot be said about the general class of 
nonlinear problems [|2l. 

In the world of digital communications, various types of error rates often serve as objective 
or constraint functions during optimization [|3l- fiT0l . Therefore, their convexity properties are of 
considerable importance. While, in some simple scenarios, the convexity can be established by 
inspection or differentiation of corresponding closed-form error probability expressions fl3l- [|T0l . 
this approach is not feasible not only in the general case, but also in most cases of practical 
importance (e.g. modulation combined with coding etc.), since such expressions are either not 
known or prohibitively complex [[TT|. 

A general approach (i.e. not relying on particular closed-form error probability expressions) 
to convexity analysis in binary detection problems has been developed in [12]. This approach 
has been later extended to arbitrary multidimensional constellations (which can also include 
coding) in [fT3l[[T4l . In particular, it has been shown that the symbol error rate (SER) of the 
maximum-likelihood (ML) decoder operating in the AWGN channel is always convex in SNR 
in dimensions 1 and 2, and also in higher dimensions at high SNR and concave at low SNR (with 
explicitly specified boundaries of the high/low SNR regimes), for any modulation and coding. 
Bit error rate (BER) has been shown to be convex in the high SNR regime as well. These results 
have been also extended to fading channels. In particular, it was shown that "fading is never 
good in low dimensions". In a related but independent line of study, a log-concavity property of 
the SER in SNR [dB] for the multi-dimensional uniform square-grid constellations (M-QAM), 
including fading and diversity reception, has been established in [fTSl and a number of new local 
SER bounds have been obtained based on it. 

In the present paper, the earlier results in [14] are expanded in several directions, including an 
extension to a class of decoders and a wide class of noise densities (significantly different from 
Gaussian), as well as tightening the high/low SNR bounds of the convexity/concavity regions 
reported in [[T4l . 

While the utility of the Gaussian noise model is well-known, there are a number of scenarios 
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where it is not adequate, most notably an impulsive noise lfT8llfT9ll[|23l[|26ll - ll3T1l with tails 
much heavier than Gaussian. To address this, an important and natural generalization of the 
Gaussian random process has been developed, namely, the spherically-invariant random process 
(SIRP). It has found a wide range of applications in communications, information-theoretic and 
signal processing areas [|20l - [|2Tl . This class of processes, while having some of the important 
properties of the Gaussian process, significantly extends modeling flexibility and thus can be 
applied to a wider range of phenomena such as impulsive noise, radar clutter, radio propagation 
disturbances, bandlimited speech waveforms [|23l[|26l . While the marginal PDF of a SIRP may 
be significantly different from Gaussian, this class of processes shares a number of important 
theoretical properties with the Gaussian process: it is closed under linear transformations, it is the 
most general class of processes for which the optimal MMSE estimator is linear, and the optimal 
(ML) decoding is still the minimum distance one (this may also include fading and correlated 
noise) Il20ll - ll27l . The present paper will extend this list to include the convexity properties of 
SER under a SIRP noise, which turn out to be similar to those in the AWGN channel (see section 
IIII-BI for further details). In addition, a general class of unimodal noise power densities will be 
considered and conditions on an arbitrary noise density will be formulated under which the SER 
is convex. In particular, the SER is convex in the SNR provided that the noise power density 
is decreasing around the decision region boundaries, regardless of its behavior elsewhere. It is 
convex at high SNR under a unimodal or a SIRP noise, and its is always convex (for any SNR) in 
low dimensions under SIRP noise. Similar results are obtained for convexity in signal amplitude 
and noise power (which are important for an equalizer design and a jammer optimization). All 
the results formulated for an i.i.d. noise are extended to the case of correlated noise as well. 

In general, convexity of the SER does not say anything about convexity of the BER, since the 
latter depends on pairwise probabilities of error (PEP) and not on the SER [[32ll [l5ll. Since the BER 
is an important performance indicator and thus appears as an objective in many optimization 
problems, its convexity properties are also studied here using the generic geometrical framework 
developed for the SER analysis. The setting is general enough so that the results apply to arbitrary 
constellations, bit mapping and coding. It turns out that the BER is convex at high SNR for 
a wide class of noise distributions and a class of decoders, where the high SNR boundary is 
determined by the constellation minimum distance and dimensionality, all other its details being 
irrelevant. 
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While the convexity of the PEP and the BER has been established at high SNR, the question 
remains: how relevant this high SNR regime is, i.e. does it correspond to realistic(practical) 
SNR values? This has significant impact on the result's importance and its utility when solving 
practically-relevant optimization problems. In this paper, we provide a positive answer: the high 
SNR is almost the same as that required by the channel coding theorem so that any code, 
including capacity-achieving ones, whose decision regions include the hardened noise spheres 
(from the sphere packing/hardening arguments in the channel coding theorem [l3l [l33l ). are in 
this range. In other words, the boundary of the high SNR regime is closely matched to that in 
the channel coding theorem so that arbitrary low probability of error implies its convexity and 
hence power/time sharing does not help to reduce it further. This complements the well-known 
result that the capacity cannot be increased by power/time sharing. Any practical code whose 
decision regions include the hardened noise spheres has also convex SER, PEP and BER. This 
opens up an opportunity to apply numerous and powerful tools of convex optimization to design 
of systems with such codes on a rigorous basis. 

The main contributions are summarized as follows: 

• New tighter high/low SNR bounds of the convexity/concavity regions are obtained and it 
is demonstrated that no further improvement is possible in the general case. 

• While the earlier results in [14J were established for the ML (min-distance) decoders only, 
the same results are shown to apply to any decoder with center-convex decision regions (see 
section IIII-AI for details), of which the min-distance one is a special case. 

• While the earlier results in [|T4l were established for the AWGN channel only, the present 
paper considers a wide class of noise densities of which Gaussian is a special case (e.g. generic 
unimodal, SIRP etc.). In particular, the SER and the BER are shown to be convex at high SNR 
for this wider class as well; the SER turns out to be convex in low dimensions not only for the 
Gaussian, but also for an arbitrary SIRP noise. The constellation dimensionality and minimum 
distance appear as the main factors affecting the convexity properties. 

• The boundary of the high SNR regime (where the SER/BER convexity is ensured) is shown 
to be closely linked to the channel coding theorem, so that error rates of capacity-achieving codes 
(with vanishingly-small probability of error) are convex. 

• Any flat-fading and any linear diversity combining are shown to be convexity-preserving, 
so that fading is never good in low dimensions under spherically-invariant noise, including linear 
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diversity combining. 

Tables 1, 2 and 3 summarize the results for convexity properties in the SNR/signal power, 
signal amplitude and noise power. Unless otherwise indicated, a non-fading channel, an arbitrary 
constellation and a decoder with center-convex decision regions are assumed. 

TABLE I 

Convexity properties of the SER/PEP/BERin the SNR/signal power. 



Convexity/concavity: scenario 


Where 


AWGN: SER is convex at high and concave at low SNR; always 
convex in low dimensions (n < 2). 


Theorem|21 iUl (|15»: Corollarvl2.1| 


Arbitrary noise density: SER is convex if the power density is non- 
increasing at the boundaries of decision regions 


Theorem |3l Gil, ^ 


Unimodal noise: SER is convex at high SNR; always convex if the 
noise power density is non-increasing. 


Corollarv 13.11 13.21 


SIRP noise: SER is convex at high and concave at low SNR; always 
convex if n < 2. 


Theorem m (HDl, (|25} 


AWGN: BER/PEP are convex at high SNR 


See (141, m, en and Theorem |9] 


AWGN: BER is convex for capacity-approaching codes 


Ol-lllTli; Conjecture 1 


SIRP noise: BER/PEP are convex at high SNR 


Theorem [H (HD, (|39) 


Fading -I- SIRP noise (AWGN is a special case): fading is never good 
in low dimensions, including linear combining 


Propositions ID |6] 


Fading channel: any flat-fading and any linear combining are convex- 
ity preserving (under any noise) 


Proposition [T] (|28}; Propositions [S] |6] 



II. System Model 

The standard baseband discrete-time system model in an additive noise channel, which includes 
matched filtering and sampling, is 

r = s + ^ (1) 

where s and r are n-dimensional vectors representing transmitted and received symbols respec- 
tively, s G {si, S2, ..., sm}, a set of M constellation points, ^ is an additive white noise. Several 
noise models will be considered, including the AWGN one, in which case ^ ~ A/'(0, ctqI), and 
the corresponding probability density function (PDF) is 



f,{^) = {2r:al)-^'e 



n/2 -|x|2/2<t2 



(2) 
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TABLE II 

Convexity properties of the SER in signal amplitude 



Convexity/concavity: scenario 


Where 


AWGN: SER in convex at high and concave at low SNR; always 
convex if n — 1. 


Theorem m Corollary |6.l| 


Arbitrary noise density: SER is convex if the noise amplitude density 
is non-increasing at the boundaries of decision regions 


Theorem [7] 


Unimodal noise: SER is convex at high SNR; always convex if the 
noise amplitude density is non-increasing. 


m 


SIRP noise: SER is convex at high and concave at low SNR; always 
convex if n = 1. 


Theorem [8] Corollary |8.1| 



TABLE III 
Convexity properties of the SER/PEP/BERin noise power. 



Convexity/concavity: scenario 


Where 


AWGN: SER in convex at high(low) and concave at low(high) 
SNR(noise power). 


Theoremll2l (143b. (144k; Corollarvll2.1l 


SIRP noise: SER is convex at high and concave at low SNR. 


Theorem Il3l 


AWGN: PEP in convex at high and low SNR. 


Theorem [13 ((52), (|53}. 


AWGN: BER in convex at high SNR. 


Corollarvll4.1l (154k. 


SIRP noise: PEP/BER are convex at high SNR 


Corollarv 114.21 



fl 



where ctq is the noise variance per dimension, and n is the constellation dimensionalitjo; lower 
case bold letters denote vectors, bold capitals denote matrices, Xi denotes i-th component of x. 



|x| denotes L2 norm of x, |x| = Vx^x, where the superscript T denotes transpose, Xj denotes 
i-th vector, | A| denotes the determinant of matrix A. The average (over the constellation points) 
SNR is defined as 7 = I/ctq, which implies the appropriate normalization, j^J2i=i 1^*1 — 1' 
unless indicated otherwise. 

More general and distinctly different noise distributions will be considered as well, which 
include the SIRP and unimodal noise, see section HIl-AI and [III-BI for further details. 



'while we consider here a real-valued model, all the results extend to the complex-valued case as well by treating real and 
imaginary parts as two independent reals, so that n-D complex constellation corresponds to 2n-D real one. 
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In addition to the maximum likelihood decoder (demodulator/detector), which is equivalent 
to the minimum distance one in the AWGN and some other channels [|24ll[|26ll . 

s = argmin |r — Sj| , 

a general class of decoders with center-convex decision regions (see Definition 1 and Fig. 1) 
will be considered, for which the min-distance one is a special case. The probability of symbol 
error Pgi (also known as symbol error rate, SER) given that s = Sj was transmitted is 

where P^ is the probability of correct decision, and the SER averaged over all constellation 
points is 

EM 
Pe.Pr[s = s,] = l-P, (4) 

1=1 

Clearly, P^i and P^ possess the opposite convexity properties. Pgj can be expressed as 



Pe^ = l- /€(x)t/x (5) 



where Vli is the decision region (Voronoi region)|3, and Sj corresponds to x = 0, i.e. the origin 
is shifted for convenience to the constellation point Sj. For the min-distance decoder, f2j can be 
expressed as a convex polyhedron [[1], 

f], = {x| Ax < b} , aj = |^^'~^^| , b, = I |s, - s,| (6) 

where aj denotes j-th row of A, and the inequality in ^ is applied component-wise. 

Another important performance indicator is the pairwise error probability (PEP) i.e. a prob- 
ability Pr {sj — 7- Sj} = Pr [s = Sjl s = Sj] to decide in favor of Sj given that Sj, i ^ j, was 
transmitted, which can be expressed as 



Pr{si -^Sj} = / /^(x)rf5 



(7) 



where Vlj is the decision region for Sj when the reference frame is centered at s^. The SER can 
now be expressed as 

Pei = J2^^Pr{s,^s^} (8) 

^s = Si if r G SI;. If r ^ fiiVi, an error is declared. 
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and the BER can be expressed as a positive linear combination of PEPs [[32ll 

M , 

BER = E E wiif ^' ^" = '^^ ^' ^'^ ^ '^-^ ^^^ 

where hij is the Hamming distance between binary sequences representing Sj and Sj. 

Note that the setup and error rate expressions we are using are general enough to apply to 
arbitrary multi-dimensional constellations, including coding (codewords are considered as points 
of an extended constellation). We now proceed to convexity properties of error rates in this 
general setting. 

III. Convexity of Symbol Error Rates 
Convexity properties of symbol error rates of the ML decoder in SNR and noise power have 



been established in 111311 ^ 4 || for arbitrary constellation/coding under ML decoding and AWGN 
noise and are summarized in Theorem 1 below for completeness and comparison purposes. 

Theorem 1 (Theorems 1 and 2 in [14]): Consider the ML decoder operating in the AWGN 
channel. Its SER Pe(7) is a convex function of the SNR 7 for any constellation/coding if n < 2, 

d^Pe{l)/d^^ = Pe(7)" > (10) 

For n > 2, the following convexity properties hold: 

• Pe is convex in the high SNR regime, 

7>(n + v^)/rf^i, (11) 

where dmm = niinj{(imin,j} is the minimum distance from a constellation point to the 
boundary of its decision region over the whole constellation, and dmm,i is the minimum 
distance from Sj to its decision region boundary, 

• Pe is concave in the low SNR regime, 

7 < (n - v^)/rfLx (12) 

where c/max = maxj{t/max,i}» and (imax.i is the maximum distance from s^ to its decision 
region boundary, 

• there are an odd number of inflection points, Pe{l)" = 0, in the intermediate SNR regime, 

[n - V2^)/dl,^ <l<{n + y2^)/<i, (13) 

The same results can be extended to P^i via the substitution (iinax(min) — ^ '^max,i(min,j) in the 
inequalities above. 
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A. Convexity in SNR/Signal Power 

Since the high/low SNR bounds in Theorem 1 are only sufficient for the corresponding 
property, a question arises whether they can be further improved. Theorem 2 gives an affirmative 
answer and demonstrates that no further improvement is possible. 

Theorem 2: Consider the ML decoder operating in the AWGN channel. Its SER Pei'j) has 
the following convexity properties: it is convex in the high SNR regime, 

7>(n-2)/c?L„ (14) 

it is concave in the low SNR regime, 

7 < (n - 2)/rfLx (15) 

and there are an odd number of inflection points in-between. The high/low SNR bounds cannot 
be further improved without further assumptions on the constellation geometry. 

Proof: See Appendix. ■ 

Note that the high/low SNR bounds in Theorem |2] are tighter than those in Theorem \T\ since 

n — \r2Jn < n — 2 < n + y2n for n > 2. 



Convexity of the SER for n < 2 is also obvious from this Theorem. In the case of identical 
spherical decision regions, a more definite statement can be made. 

Corollary 2.1: Consider the case of Theorem |2] when all decision regions are sphered! of the 
same radius d. The following holds: 

• The SER is strictly convex in 7 in the high SNR regime: 

Pe(7)">0if7> {n-2)/d'^ 

• It is strictly concave in the low SNR regime: 

Pi (7)" < if 7 < (n - 2)/d'^ 

• There is a single inflection point: 

Pe(7)" = 0if7 = (^-2)/rf' 

'if the received signal does not belong to any of the decision regions, an error is declared. 
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Fig. 1. Center-convex decision region Hi centered on Si. 



Note that this result cannot be obtained from Theorem [T] directly, as the bounds there are not 
tight. It also follows from this Corollary that the high/low SNR bounds of Theorem [2] cannot be 
further improved in general (without further assumptions on the constellation geometry). 

The results above are not limited to the AWGN channel but can also be extended to a wide 
class of noise densities and a class of decoders, as Theorem |3] below demonstrates. We will need 
the following definition generalizing the concept of a convex region. 

Definition 1: A decision region is center-convex if any of its points can be "seen" from the 
center (i.e. the corresponding line segment connecting the point to the center belongs to the 
region). 

Note that any convex region (e.g. a convex polyhedron) is automatically center-convex but 
the converse is not necessarily true, so that ML/min-distance decoders are a special case of a 
generic decoder with center-convex decision regions. As an example. Fig. 1 illustrates such a 
decision region, which is clearly not convex. 

To generalize the results above to a wide class of noise densities, we transform the Cartesian 
noise density /^(x) into the spherical coordinates {p,0), 

xi = croA/psin6'i (16) 

X2 = ctq -\/p cos 9i sin 02 

Xn-\ = (Toy/pCOs6i..COs6n^2Sm6n^i 
Xn = CTq y/p COS 6 1.. COS 6 n-2 COS 9 n-1 
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where = {6i, ..,6'„_i} are the angles, — 7r/2 < 6i < n/2 for i = l...n — 2, —n < 6'„_i < n, 
and p represents the normalized noise instant power I^P/ctq, so that 

f,,e{p,e) = \dx/dip,e)\f^{^) (17) 

where 

J = \dx/d{p, 6) I = (T^p"/2-^ COs"-2 en-2 COS"-^ On-^.. COS Oi 

is the Jacobian of transformation from x to {p,0), and fp^g(p,0) is the noise power density 
in the spherical coordinates (see [|35l[|24l for more on spherical coordinates and corresponding 
transformations). For simplicity of notations, we further drop the subscripts and use f{p, 6). 

We are now in a position to generalize Theorem |2] to a wide class of noise densities and the 
class of center-convex decoders. 

Theorem 3: Consider a decoder with center-convex decision regions operating in an additive 
noise channel of arbitrary density f{p, 6). The following holds: 

PeilT > if f;{p,0) < V0,p e [7<in,7<aJ, (18) 

where fp{p, 6) = df{p, 6) /dp. In particular, Pe{l) is convex in the interval [71, 72] if the noise 
density /(p, 6) is non-increasing in p in the interval [7i<^mm;720^max]' 

Pe{l)" > V7 e [71,72] if fl{p.e) < V0,p G [7i<in,72rfLx], (19) 

Proof: See Appendix. ■ 

Note that it is the (non-increasing) behavior of the noise power density in the annulus 
[7i'^min)72'^max]' l-^- ^round the boundaries of decision regions, that is responsible for the 
convexity of Pe{l)\ the behavior of the noise density elsewhere is irrelevant. 

The inequalities in (fTSi) and (fT9l) can be reversed to obtain the corresponding concavity 
properties. The strict convexity properties can also be established by considering decoders with 
decision regions of non-zero measure in the corresponding SNR intervals. Convexity of individual 
SER Pei can be obtained via the substitution (imin(max) — >■ o?min,j(max,j)- It is also straightforward 
to see that Theorem |2] is a special case of Theorem |3] 
Let us now consider more special cases of Theorem |3] 
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Fig. 2. Gaussian noise power density for n — 10. It is unimodal with p* = 



Corollary 3.1: Consider a decoder with center-convex decision regions operating in an addi- 
tive noise channel of a unimodal noise power densitjQ 



fp{P,0){ 



(20) 



> 0, p < p* 

= 0, p = p* 

< 0, p> p* 

i.e. it has only one maximum at p = p*; it is an increasing function on one side and decreasing 
on the other (see e.g Fig. 2, 3). Its SER is convex at high and concave at low SNR: 

Pe(7r>0, 7>p7^L. 
Pe(7)" < 0, 7 < P*/dl 



(21) 



max 



Corollary 3.2: Consider the case of monotonically-decreasing (in p) noise power density, 
f'p{p, 0) <0 Vp, 0. Then, the SER is always convex: Pe(7)" > V7. ■ 

Since the Gaussian noise power density is unimodal with p* = n — 2 (see Fig. 2), Corollary 
13.11 applies to the AWGN channel as well, thereby generalizing Theorem |2] to decoders with 
center-convex decision regions. The AWGN for ra = 1, 2 is also a special case of Corollary 13.21 



which is also quasi-concave |1|; many popular probability density functions are unimodal. 
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Fig. 3. Laplacian noise power density for n = 10. It is unimodal with p* = 64. 
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Fig. 4. The power density of Gaussian noise: while it is monotonically decreasing for n — 1,2 and Vp, it is unimodal for 
n > 3. 



These Corollaries allow one to answer the question "Why is the SER in the AWGN channel 
always convex for n = 1,2 but not for n > 3?" - the reason is the monotonically decreasing (in 
p) nature of the noise power density /(p, 9) for any p in the former but not the latter case, see 
Fig. 4. 
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Other examples of unimodal densities include Laplacian noise with the Cartesian PDF /^(x) = 
c ■ e"l^l, where c is a normalizing constant, so that the spherical one is 

where f{6) is the angular density. It is straightforward to see that this power density is unimodal 
in p with p* = (n — 2y, see Fig. 3. Importance of this distribution for communication/information 
theoretic problems is discussed in [|36l - [l38l . A more general example is a power exponential 
distribution [I37l-[l39ll 

(also known as generalized Gaussian [|26l or, in a slightly modified form, as WeibuU distribution 
[|40l - [|42]| ) whose spherical density is 

f{p,e) = c-p''/'-'e'^'f{e),(3>o, 

which is also unimodal in p with 



p 



r^-2^^/^ 



2/3 

This distribution has a heavier (for /3 < 1) or lighter (for (3 > 1) tail than the Gaussian one, 
so that it offers a significant flexibility in noise modeling. In fact, it was shown in [l39l that 
WeibuU distribution can be presented as a mixture of normal distributions, where the variance 
of normal distribution is treated as a random variable with an a-stable distribution. This fits 
well into a typical model of interference in random wireless networks, where the interference 
distribution also follows an a-stable law [|28l - [l3TI : each node transmits a Gaussian (capacity- 
achieving) signal of a fixed transmit power; at the receiver, the noise power coming from each 
node is random (due to random distance to transmitting nodes) and follows an a-stable law, so 
that the composite noise instant power follows the power exponential distribution. 

Some spherically-invariant random processes or vectors considered in [|22l - [|26l also belong 
to the classes considered in these Corollaries or in Theorem [3l as discussed next. 

B. Convexity of SER under SIRP noise 

In this section, we consider an additive noise channel when the noise distribution follows 
that of a SIRP. The characterization of the SIRP class is strikingly simple: any SIRP process 

May 1, 2013 DRAFT 



15 

is conditionally Gaussian, i.e. a Gaussian random process whose variance is a random variable 
independent of it. In the context of wireless communications, this structure represents such 
important phenomena as channel fading, random distance between transmitter and receiver etc. 
Below, we establish the SER convexity properties under a SIRP noise thus generalizing further 
the results of the previous section. 

The following is one of the several equivalent definitions of a SIRP ll20ll -[[24 l| . 

Definition 2: A random process {X(t),t E R} is a SIRP if a vector of any of its n samples 
X = {X{ti),X{t2)..X{tn)} has the PDF of the following form: 

/x(x) = c„/i„(x^C;^x) (22) 

where Cn is the covariance matrix, /i„(V) is a non-negative function of the scalar argument 
r > 0, and c„ is a normalizing constant, u ■ 

In fact. Definition 2 says that the PDF of SIRP samples depends only on the quadratic form 
x^C~^x rather than on each entry individually, so that any linear combinations of the entries of 
X having the same variance will also have the same PDF [|20l . Distributions of the functional 
form as in (|22] ) are also known as elliptically-contoured distributions [|35l . The characterization 
of SIRP is as follows (the SIRP representation theorem) [I22]l-[l24ll. 

Theorem 4: A random process is a SIRP iff any set of its samples has a PDF as in (|22)) with 



hn{r) = I a-" exp {-^| fi^)dcT, < r < oo, (23) 

where /i„(r) is defined by continuity at r = 0, and f(a) is any univariate PDF. ■ 

An equivalent representation is X{t) = CY{t), where Y(t) is the Gaussian random process 
of unit variance, and C is an independent random variable of PDF /(fx), so that Theorem |4] 
basically says that any SIRP can be obtained by modulating the Gaussian random process by an 
independent random variable [|25l . A number of PDFs that satisfy Theorem |4] and corresponding 
/(cr) can be found in [|26l (which include Laplacian and power exponential densities above). 

It was shown in (26\ that the optimal decoder under the SIRP noise is still the minimum 
distance one (which follows from the fact that hn{r) in (|23l) is monotonically decreasing in r). 

^An equivalent definition in terms of the characteristic function is also possible. Note also that not any h„{r) will do the job, 
but only those satisfying the Kolmogorov consistency condition I22I - I24I . 
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Using this, we are now in a position to establish the SER convexity properties under SIRP noise 
with C = I. 

Theorem 5: Consider an additive SIRP noise channel, where the noise density is as in (|22l) and 
(1231) with C = I. Assume that /(cr) in (l23l) has bounded support: /(cr) = Vcr ^ [ai, a2\. Then, 
the SER of any decoder with center-convex decision regions (including the min-distance/ML 
one as a special case) operating in this channel is convex at high and concave at low SNR as 
follows: 

Pe{Ps)" > 0i{ps>{n-2)al/dl,^ (24) 

PeiPs)" < 0ifps<in-2)af/dl,^ (25) 

where ps is the signal power, and d^an(max) is the minimum (maximum) distance in the normalized 
constellation (corresponding to ps = I). 

Proof: See Appendix. ■ 

Note that the high/low SNR bounds are independent of a particular form of /(cr), but depend 
only on the corresponding boundaries of its support set. A particular utility of this Theorem 
is due to the fact that closed-form expressions of Pe{Ps) are not available in most cases so its 
convexity cannot be evaluated directly. The following Corollary is immediate. 

Corollary 5.1: Consider a decoder with center-convex decision regions operating in the SIRP 
noise channel as in Theorem |5] without the bounded support assumption. Its SER Pe{Ps) is 
always convex when n < 2: Pe{ps)" > Vp^. ■ 

Thus, the SER is convex in low dimensions for all the noise densities in Table I in [f26l 
(i.e. contaminated normal, generalized Laplace, Cauchy and Gaussian), which extends the cor- 
responding result in Theorem 1 to a generic SIRP noise. 

While Corollary 3.1 characterizes the SER convexity for the identical spherical decision regions 
in the AWGN channel, such a simple characterization is not possible in a SIRP channel in general 
(when o"! ^ a2), as Theorem |5] shows. 

C. Non-negative Mixture is Convexity-Preserving 

The next proposition generalizes further the results above and shows that any non-negative 
mixture of noise densities is convexity-preserving in terms of error rates of a given decoder for 
any variable of interest. We will need the following definition. 
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Definition 3: Let {/j} be a set of noise densities, i = l...m. Its convex hull [JJ is any non- 
negative liniear combination which is also a density, 

i i 

Proposition 1: Let -Pe[/] be an error rate of a given decoder as a functional of noise density / 
and let all Pe[fi] be convex, Pe[fi]" > Vz, where the derivative is over any variable of interest 
(SNR, power/amplitude of signal/noise). Then, 



Pelf]" > v/ G n{f^} 



(26) 



Proof: A key observation here is to note, from dD, that that the probability of correct 
decision Pc[f] = 1 — Pe[f] is a linear functional of the underlying noise density /, 



Pr 



^aifi 



J^Pr{s = Sfe}/ ^aifi{x)dx 
k -^^fe i 

^ai^Prjs = Sfc} / fi{x)dx 



(27) 



Since ctj > and each Pc [fi] is concave, so is Pc[f], from which the result follows. ■ 

Thus, a convexity of error rates of a given decoder for {fi} is sufficient to insure the convexity 

for any / in the convex hull of {fi}. 

The same preservation holds for concavity and also when the corresponding property is strict. 

It can be further extended to continuous mixtures as well. 



P. 



/ p{a)fada > if Pe[fa]" > Va, p{a) > 0, / p{a)da = 1 (28) 

where fa is the noise density parameterized by a continuous mixture parameter a and p{a) is 
a (non-negative) density of a. Such a mixture can model a fading channel where a represents 
the channel (random) gain, so that (|28] ) states in fact that (flat) fading is a convexity-preserving 
process. This will be elaborated in further details in Section |VIl 

Observe that the same convexity -preserving property holds in terms of the signal power/amplitude 
and noise power/amplitude, due to the linearity of Pc[f]- Note also that Proposition [H and (|28l) 
extend the confexity/concavity properties to a very broad class of noise densities, which includes. 
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as a special case, the SIRP noise, and do not even assume convex or center-convex decision 

regionqj- 

The following result is a direct consequence of Proposition [1] 

Proposition 2: Let C be a set of all noise densities for which error rates of a given decoder 
are convex (in any variable of interest). C is a convex set. 

D. Convexity in Signal Amplitude 

Convexity of the SER as a function of signal amplitude A = ^/7, Pe{A), is also important 
for some optimization problems (e.g. an equalizer design). For the ML decoder operating in 
the AWGN channel those properties have been established in [14J, which are summarized in 
Proposition |3] for completeness. 

Proposition 3: Consider the ML decoder in the AWGN channel. Its SER Pei{A) as a function 
of signal amplitude A has the following convexity properties: 

• Pei{A) is always convex in A if n = 1, 

• For n > 1, it is convex in the large SNR regime A > y/ai/dmin,i and concave in the small 
SNR regime A < y/a^/dma.x,i, where 

ai = (2n + 1 + V8n + l)/2, as = (2n + 1 - VSn + l)/2 

and there are an odd number of inflection points in-between. 

• The same applies to Pe{A) via the substitution (ijnax(min),j ~^ '^max(min)- ■ 

The next Theorem provides tighter high/low SNR bounds, which cannot be further improved 
in general, and also extends the result to any decoder with center-convex decision regions (of 
which the ML/min-distance one is a special case). 

Theorem 6: Consider a decoder with center-convex decision regions operating in the AWGN 
channel. Its SER Pei{A) as a function of signal amplitude A has the following convexity 
properties for any n: 

• The SER is convex in A in the large SNR regime: 



Pei{A)" > if A > V^r^T/drain,i 
*To the best of our knowledge, this is the most general known result about the convexity properties of error rates. 
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• It is concave in the small SNR regime 



Pei{A)" < if A < Vrr^T/c?n,ax,i 

• There are an odd number of inflection points in-between. 

• The bounds cannot be further tightened in general (without further assumptions on the 
constellation geometry). 

• The same applies to -Pe(^) via the substitution (imax(min),j — > '^max(mm)- 

Proof: See Appendix. ■ 

Note that the convexity of PeiiA) for ra = 1 and any A follows automatically from this 
Theorem. It is straightforward to see that the bounds of Theorem |6] are indeed tighter than those 
of Proposition 1, since 

a2 < n — 1 < ai 

with strict inequality for n > 2. The following is a direct consequence of Theorem |6l which 
cannot be obtained from Proposition 1. 

Corollary 6.1: Consider the case of Theorem |6] when all decision regions are the spheres of 
same radius d. The following holds: 

• The SER is strictly convex in A in the large SNR regime: 



Pe{A)" > if A > V^T^T/t^ 
• It is strictly concave in the small SNR regime: 



Pe{A)" < if A < yAi^l/d 
There is a single inflection point: 



Pe{A)" = oif A = v^r^/d 

■ 

Theorem |6]can also be extended to a wide class of noise densities following the same approach 
as in Theorem |3] 

Theorem 7: Consider a decoder with center-convex decision regions operating in an additive 
noise channel of arbitrary density f{r,0), where r represents the normalized noise amplitude 
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|^|/(To. The SER Pe{A) is convex in A in the interval [^1,^2] if the noise density f{r,6) is 
non-increasing in r in the interval [Airfmin, v42C?max]: 

PM)" > VA G [Ai, A2] if /;(r, 0) < V0, r G [Aif^^i^, ^c^^aj, (29) 

Proof: See Appendix. ■ 

Similarly to Theorem |3l the inequalities can be reversed to obtain the concavity properties 

and unimodal densities are a special case. In particular, Corollary 13 . 1 1 holds with the substitution 

p — )■ r, 7 — > y4, and (|2TI) reads as 

PM)" > if A > r7<i, 

(30) 

Pe{Ay < if A < rV^ax 

The Gaussian, Laplacian and exponential noise amplitude distributions are all unimodal, with 
r* = ^n — 1, r* = n — 1 and r* = {{n — l)/2/3)-'^/^^ respectively, so that the SER is always 
convex if n = 1. 

For the case of a SIRP noise as in Theorem |5l one obtains the following. 

Theorem 8: Consider an additive SIRP noise channel with the density as in (|22l) . (|23l) and 
C = I. Assume that /(cr) has bounded support: /(a) = Vcr ^ [ai,a2]- Then, the SER of 
any decoder with center-convex decision regions operating in this channel is convex at high and 
concave at low SNR as a function of signal amplitude A: 



Pe{A)" > if A > a2Vn - l/<in (31) 

Pe{A)" < OifA<aiV^r^l/d^^^ (32) 

where (imm(max) is the minimum (maximum) distance of the normalized constellation (i.e. the 
one that corresponds to A = 1). 

Proof: See Appendix. ■ 

The following is immediate. 

Corollary 8.1: Consider the scenario in Theorem |8] for n = 1 without the bounded support 
assumption. The SER is always convex in A: Pe{A)" > VA. ■ 

E. Extension to Correlated Noise 

While Theorems 2, 5, 6, 8 and corresponding Corollaries apply to a channel with i.i.d. noise, 
a similar result can be established when noise is not i.i.d. (i.e. correlated or/and of non-identical 
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variance per dimension). Let us consider the model in dD, where the noise covariance is R^ = 
E{^^^}. Applying the sufficient statistics approach, one can use r' = R7 r instead of r 
as decision variables without affecting the performance (i.e. a whitening filter). The equivalent 
channel 

r' = R-^/'(s + (33) 

has i.i.d. noise Rt $, and the equivalent constellation is {s'^} = {R^ Sj}, so that equivalent 
decision regions ri[ and corresponding minimum/maximum distances can be found to which 
Theorems 2, 5, 6, 8 apply. In particular, the SER is still convex at high SNR. Note that Theorems 
3 and 7 do not require the noise to be i.i.d. 

IV. Convexity of BER and Capacity- Achieving Codes 

While the previous sections have established the convexity properties of the SER, it does not 
imply the corresponding convexity properties of the BER as the latter depends on the pairwise 
probability of error and not just the SER (see e.g. (|9])). The PEP and the SER have somewhat 
different convexity properties. The convexity of the PEP has been established in [[T4l| and, based 
on it, the following result was obtained. 

Theorem 9: Consider the ML decoder operating in the AWGN channel. Its BER, SER and 
PEP are all convex functions of the SNR, for any constellation, bit mapping and coding, in the 
high SNR (small noise) regime, when 

d^n > ('^ + V2n)al (34) 

■ 

Note that the lower bound in (|34l) has an interesting interpretation: na^ is the mean of |^p and 
\/2naQ is its standard deviation, so that (|34l) requires that di^^^ be larger than the average noise 
power by at least its standard deviation, which is intuitively what is required for low probability 
of error. Thus, the condition in (|34] ) should be satisfied when probability of error is small. 

Below, we make this statement more precise and proceed to establish practical relevance of the 
high-SNR regime in (|34l) based on the channel coding theorem. Recall that the sphere hardening 
argument (from the channel coding theorem) states that the noise vector ^ is contained within the 



sphere of radius y^n (ctq + e) with high probability (approaching 1 as n — )■ oo) [f33l [l3ll. where 
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e > is a fixed, arbitrary small number, so that the decision regions should have minimum 
distance to the boundary 

dL^>nial + e), (35) 

i.e. to enclose the hardened noise sphere of radius ^/n {a^ + e), to provide arbitrary low prob- 
ability of error as n — )■ oo. For any code satisfying this requirement, it follows that 



<in > n {a^o +e)>{n + V2^)al (36) 

for sufficiently large n and Ve: > 0. Thus, for any code whose decision regions enclose the 
hardened noise spheres, the condition of Theorem |9] is satisfied and therefore the error rates 
(SER, PEP, BER) of such codes are all convex. 

On the other hand, for any code whose decisions regions are enclosed by the spheres of radius 



2nao, i.e. d'^^^^ < {n + y/2n)aQ , the symbol error rates are lower bounded as 

Pe^>Prj^^>U^g(l)^0.16>0, (37) 



n 



where Q{x) = -^ /^°° e~* ^'^dt is the Q-function, so that arbitrary-low probability of error is 
not achievable. Based on these two arguments, we conjecture the following. 

Conjecture 1: Consider a capacity-achieving code designed for SNR = 70. Error rates of any 
such code are convex for SNR > 70, i.e. when it provides an arbitrary low probability of error. 
■ 

This conjecture is stronger that our convexity statement above since the latter requires the 
decision regions to include the hardened noise spheres, which is only a sufficient condition for 
arbitrarily low probability of error, so that it is possible that a capacity-achieving code violates 
the condition in (l36l) . The conjecture effectively states that, if present, such a violation is minor 
in nature and does not affect the convexity property. 

As an application of this result, we note that power/time sharing cannot reduce error rates of 
any code for which (|34] ) holds. This complements the well-known result that power/time sharing 
cannot increase the capacity. 

In summary, any code respecting the noise sphere hardening and hence having low probability 
of error will also have convex error rates (SER, PEP and BER). This is the way convexity 
intimately enters into the channel coding theorem. 
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Theorem |9] can also be extended to a wide class of decoders with center-convex decision 
regions under a SIRP noise as follows. To separate the effects of noise power (ctq) and the shape 
of its PDF, let us consider the normalized noise ^/ao and assume that it has the PDF as in (|22l) . 
(|23] ). where a is now a normalized conditional standard deviation and /(cr) is its PDF. 

Theorem 10: Consider a channel with an additive SIRP noise as in Theorem |4] when the PDF 
f{a) of conditional normalized standard deviation has bounded support: 

/(a) = 0Va^[ai,(72] (38) 

The PEP, SER and BER of any decoder with center-convex decision regions (e.g. min-distance 
decoder for any constellation, bit mapping and coding) operating in this channel is a convex 
function of the SNR in the high SNR/low noise regime, 

dl,,>in + V2^)iaocJ2y (39) 

Proof: See Appendix. ■ 

Theorem [To] essentially says that Theorem |9] also applies to a SIRP noise channel provided the 
maximum conditional noise variance is used in (|34] ). We remark that it is only the constellation 
dimensionality and the minimum distance that determine its BER convexity and only via the 
bound in (l39l) . all its other details being irrelevant. As far as the noise is concemed, it is only the 
maximum conditional variance (0-00-2)^ that matters and only via the same bound. A particular 
functional form of f{a) is irrelevant, i.e. many different unconditional noise distributions will 
induce the same convexity properties in the high-SNR regime. 

V. Convexity of Error Rates in Noise Power 

In a jammer optimization problem, it is convexity properties in noise power that are important 
[fT2l . Motivated by this fact, we study below convexity of the SER, the PEP and the BER in the 
noise power. 

The following result has been established in [|T4l . 

Theorem 11 (Theorem 4 in ^14^): Consider the ML decoder operating in the AWGN channel. 
Its symbol error rates have the following convexity properties in the noise power ctq, for any 
constellation/coding, 

• Pe is concave in the large noise regime, 

«n^0 > ^max (40) 
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where a„ = n + 2 — \/2(n + 2), 

• Pe is convex in the small noise regime, 

hnOl < rfLn (41) 

where 6„ = ra + 2 + A/2(n + 2), 

• there are an odd number of inflection points for intermediate noise power, 

C^min^n^ < ^0 < ^la^Ai^ (42) 

■ 

The following Theorem tightens the high/low SNR bounds above and also shows that the new 
bounds cannot be further improved in general. 

Theorem 12: Consider a decoder with center-convex decision regions operating in the AWGN 
channel. Its symbol error rates have the following convexity properties in the noise power: 

• Pe is concave in the large noise regime, 

[n + 2)al > rfL, (43) 

• Pe is convex in the small noise regime, 

{n + 2)al<dl^ (44) 

• there are an odd number of inflection points for intermediate noise power, 

dl,^ < (n + 2)a', < ^Lx (45) 

• These bounds cannot be improved in the general case. 

Proof: See Appendix. ■ 

Note that the bounds of Theorem [T2] are indeed tighter than those of Theorem [TTl since 

an <n + 2 <bn (46) 

We further remark that similar results apply to Pg^j via the substitution (imax(min) — ^ '^max(min),i- 
The following Corollary, which cannot be obtained from Theorem [TTl follows immediately 

from Theorem \T2\ 

Corollary 12.1: Consider the scenario of Theorem [T2]when all decision regions are the spheres 

of same radius d (= rfmax = c^min)- The SER has the following convexity properties in noise 

power (Tq: 
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• Peici) is Strictly concave in the large noise regime, 

or2>rfV(n + 2) (47) 

• It is strictly convex in the small noise regime, 

a^ < S/{n + 2) (48) 

• There is a single inflection point, 

P,{al)" = iff al = (f/{n + 2) (49) 

■ 

Note that unlike Pe{l), which is convex in low dimensions (n = 1, 2) so that the transmitter 
cannot employ power/time sharing to reduce error rate, -Pe(cro) does not possess this property so 
that the jammer can increase error rate by power/time sharing even in low dimensions (in the 
low noise regime). In this respect, the jammer is in a more advantageous position compared to 
the transmitter in the AWGN channel. It is also clear from this Corollary that the high/low SNR 
bounds of Theorem [12] cannot be improved in general. 

Theorem [l2] can be also extended to a wider class of SIRP noise. As in Theorem [lOl we 
consider the normalized noise ^/o"o to separate the effects of the noise power (ctq) and the shape 
of its PDF, and assume that the normalized noise power has the PDF as in (|22|) . (|23l) . where 
f{a) has bounded support as in (|38T ). 

Theorem 13: Consider a decoder with center-convex decision regions operating in a SIRP 
noise channel channel under the stated-above conditions. Its symbol error rates have the following 
convexity properties in the noise power: 

• Pe is concave in the large noise regime, 

(n + 2)(aiao)'>dLx (50) 

• Pe is convex in the small noise regime, 

{n + 2){a2CTof<dl,^ (51) 

• there are an odd number of inflection points for intermediate noise power. 

Proof: See Appendix. ■ 

Let us study now the convexity/concavity properties of the PEP as a function of noise power. 
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Theorem 14: Consider a center-convex decoder operating in the AWGN channel. Its PEP 
Pr{sj — )■ Sj} is a convex function of the noise power ctq, for any n, in the low noise (high SNR) 
regime, 

hnOl < Cn, (52) 

and in the high noise (low SNR) regime, 

a„o-Q > {dij + dmaxj) (53) 

where dij = |sj — Sj|, and has an even number of inflection points in-between. 

Proof: See Appendix. ■ 

Note that unlike the SER, the PEP is convex in the low SNR regime if dmn^j < oo. Based 
on this Theorem, a convexity property of the BER follows. 

Corollary 14.1: For any constellation, bit mapping and coding, the BER of a center-convex 
decoder operating in the AWGN channel is a convex function of the noise power in the low 
noise (high SNR) regime: 

bncrl < rfLn (54) 

where the specifics of the constellation/code determine only the high-SNR boundary via d^^i^. 
U 

We remark that for any code respecting the sphere hardening argument, 

c^min >n{aQ + e) > 6„cro, (55) 

for sufficiently large n, so that the BER is a convex function of the noise power. For such codes, 
power/time sharing does not help to decrease the BER, but it is always helpful for a jammer 
whose objective is to increase the BER. A jammer transmission strategy to maximize the SER 
via a time/power sharing has been presented in [ [T4] and, with some modifications, it can also 
be used to maximize the BER, following the convexity result in Corollary 114.11 

These results can also be extended to a SIRP noise channel. 

Corollary 14.2: Consider a SIRP noise channel, where the conditional noise power a"^ has 
bounded support 

The results of Theorem [14] and Corollary 114.11 apply with the substitutions ag — t- (72 for (|52] ) 
and dSll), and (Tq -^ cxi for ^3}. ■ 
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VI. Convexity in Fading Channels 

The convexity properties of error rates in non-fading channels can also be extended to fading 
channels. Let us consider the following standard flat-fading channel model, which is a general- 
ization of ([U), 

r = hs + ^ (56) 

where h is a (scalar) fading channel gain, so that the instantaneous SNR is 7 = |/ip7o, and the 
instantaneous error rate is -Pe(7) = -Pe(|^p7o)- The average error rate Pe(7o) as a function of 
the average SNR 7 = 70 = I/ctq is obtained by the expectation over the fading distribution, 

Pe(7o) = IW) = [ Pem'lo)f{h)dh (57) 



where f{h) is the PDF of h, and where (•) denotes the expectation over the fading distribution. 

If the instantaneous SER Pe(7) is convex for any SNR 7, the following result is immediate. 

Proposition 4: Consider a fading channel under additive noise with monotonically-decreasing 
power density, e.g. a SIRP noise for n < 2. The average SER of a decoder with center-convex 
decision regions operating in this channel is lower bounded by the non-fading SER at the same 
(average) SNR for any fading distribution: 

Peilo) > Peilo) (58) 

i.e. fading is never good in low dimensions under a SIRP noise. 

Proof: Follows from Jensen inequality [[T] by observing that Pe{l) is convex in 7 under the 
stated assumptions. ■ 

Let us now consider the average error rate Pe(7o) as a function of the average SNR 70. 

Proposition 5: Consider a fading channel in (l56l) and assume that the instantaneous SER 
Pe{l) is convex for any SNR 7 (e.g. a SIRP noise for n < 2 or any noise with monotonically- 
deceasing power density under a center-convex decoder), then the average SER Pe(7o) is also 
convex in the average SNR 70 in such channel, i.e. fiat-fading is a convexity-preserving process. 
Proof: Follows from (l57l) since non-negative linear combination preserves convexity [HI or, 
equivalently, by using the convexity-preserving property in (|28l) . ■ 

We note that Propositions |4] and |5] extend the corresponding results in lfT4l obtained for the 
Gaussian noise and the ML decoder to a broad class of noise distributions and decoders. It 
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appears that it is the constellation dimensionality that has a major impact on convexity of the 
SER, rather than the specifics of the noise or the fading distribution. 

These results can be further extended to diversity combining systems over such channel, which 
is a popular way to combat the detrimental effects of fading [I3l-ll5l. 

A. Convexity under diversity combining 

Consider a maximum ratio combiner (MRC) operating over an m-branch fading channel as 
in (Ell), 

Ti = hs + i, (59) 

where r^, hi and ^j, are the received signal, channel (voltage) gain and noise in i-th branch, 
i = l..m. The z-th branch SNR is 7j = |/ijp7o and the combiner's output SNR is 'jout = X]i7« — 
7o|^P IBIj where h = [hi, .., hm]'^ is the vector of channel gains. The combiner's instantaneous 
error rate is Pe(|h,p7o) and the average error rate is 

Pe(7o) = j Pe{\h\^l,)f{h)dh (60) 

Using the same argument as in Proposition |51 this error rate is convex in the average SNR 70 
provided the instantaneous SER is convex for any SNR. 

This result can be now extended to an arbitrary linear combining of the form ^^ WiVi, where 
w = [wi, ...,Wm\'^ are the combining weights (which depend on the channel gains). The output 
SNR of this combiner is 'jout = lol'^'^ h\'^ ^ assuming proper normalization \w\ = 1 (note that 
normalization does not affect the SNR), so that its average error rate is 

Peho) = jPei\w^h\^lo)fih)dh (61) 

which is also convex in the average SNR provided Pe{'j) is convex, i.e. any linear combing 
is convexity -preserving. Note that the MRC is a special case of the general linear combining, 
with w = h/\h\. Other special cases are the other 2 popular combining techniques: selection 
combining (SC), which selects the strongest branch with only one non-zero weight corresponding 
to that brach, and equal-gain combing, which adds coherently the required signals with unit gain 
im. All of them preserve the convexity of error rates, which is summarized below. 

Proposition 6: Any linear diversity combining over any flat-fading channel as in (l59l) is 
convexity -preserving, i.e. given that the instantaneous SER Pei'j) is convex for any SNR 7, 
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the average SER Pe(7o) of the combiner is also convex in the average SNR 70 in such channel. 
Special cases include the maximum ratio, selection and equal gain combining. The lower bound 
in Proposition |4] also holds under any linear combining. 

The utility of this convexity-preserving property is coming from the fact that most error rate 
expressions in fading channels and under diversity combining are prohibitively complex so that 
the straightforward evaluation of convexity via differentiation is not possible, while the results 
above establish the convexity indirectly and without evaluating the integrals (the most difficult 
part). 

VII. Conclusion 

Convexity /concavity properties of the error rates (SER, PEP, BER) in an additive noise channel 
have been considered. The earlier results obtained for the AWGN channel under ML (min- 
distance) decoder [fT4l have been improved and have also been extended to a class of decoders 
with center-convex decision regions and to a wide class of noise densities (unimodal and SIRP 
noise processes). In particular, the SER is shown to be a convex function of the SNR for any noise 
with monotonically-decreasing power density (e.g. SIRP, Laplacian, WeibuU, power-exponential 
or AWGN noise in low dimensions). In higher dimensions, this property holds in the high SNR 
regime, for which the boundary has been explicitly given. The latter is such that any code that 
respects the sphere hardening condition of the channel coding Theorem also meets the high SNR 
condition so that all such codes have convex error rates (SER, PEP, BER). Fading is shown to 
be a convexity-preserving process, including any linear combining, and is never good in low 
dimensions under a SIRP noise. 

All the applications discussed earlier in f.l4J (e.g. optimization of a spatial multiplexing system, 
optimum power/time sharing for a jammer and transmitter, optimal unitary precoding for an 
OFDM system) for the AWGN channel also hold under the general SIRP or unimodal noise and 
a convex-center decoder, based on the convexity properties established here. 

VIII. Appendix 

A. Proof of Theorem |2] 

First, we transform the Cartesian noise density /^(x) into the spherical coordinates {p,9), 
where p represents the normalized noise instant power |x|^/crQ, and = {9i, ..,9n-i} are the 
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angles (see [[35l[|24l for more on spherical coordinates): 

U,e{p.e) = fe{e)U{p), (62) 

-7r/2 <ei< 7r/2, i = l...n - 2, -vr < 6^-1 < vr 
where feiG) and fp{p) are the angular and normalized noise power densities, 

fe{e) = r(n/2)7r-"/2cos"-2^„_2Cos""3e„_3-cos^i (63) 

pn/2-lg-p/2 

fpiP) = 2"/^r(n/2) ^^^^ 

where r(-) is Gamma function. Using this, the probability of correct decision Pd can be expressed 

as 

Pail) = / fe{e) / fp{p)dpde (65) 

Jne Jo 

where DO is the range of angles in (|62l) and -Ri(0) is the boundary of the normalized decision 
region (corresponding to 7 = I/ctq = !)• One can now obtain the second derivative in 7: 

Pdi)" = I fe{e)f;^{^RUe))Rt{e)de (66) 

Joe 
where 

^P^^^ 2"/2+ir(n/2) ^ -^ 

so that fp{^Rf{6)) < if ^R'^{6) > n — 2. When the latter condition holds for any 6, i.e. when 
7 > (n — 2)/(i^ij^ ■, then the integrand in (|66] ) is non-positive, since fe{9)Rf{6) > 0, and (fT4l) 
follows. Reversing the inequalities, one obtains (fT5l) . To prove that the bound in ([14]) cannot 
be further improved in general (i.e. without further assumptions on the constellation geometry). 



consider the case when all i7j are spheres of the same radius r = d^-m = d^s^y^ < \/{n — 2)/7, 
so that 7 < (n — 2)/c?^ijj = {n — 2)/(i^^^ and therefore Peil)" < 0, i.e. (fT4l) is necessary for the 
convexity of the SER in general. The bound in (fT5l) can be handled in the same way. The case 
of identical spherical decision regions follows in a straightforward way. As a side remark, we 
note that this proof is a significant simplification over those of Theorems 1 and 2 in fll4ll . ■ 

B. Proof of Theorem |2] 

In the case of generic noise density f(p,6), i.e. when (|62l) does not hold, (1651) and (l66l) are 
generalized to 

p,,(7)= / / f{p,e)dpde (68) 

Joe Jo 
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pdi)"=[ r,{iRm.o)Rmdo m 

Joe 
Now observe that Pdij)" < if f^{jRj{e),e) < V0, which holds if f'pip,0) < for 
7<^min ^ P ^ 7'^max' ^^^ ^^^ ^' ^^ that (fTSi) foUows. (fT9l ) follows by observing that its condition 
insures that the condition in (fTSi) is satisfied for 71 < 7 < 72. ■ 



C. Proof of Theorem |5] 

Using Theorem |4l the noise power density can be written as 

/■oo 

f{p) = / f{p\a)fia)da (70) 

Jo 

where f{p\cr) is the conditional power density, 

(l68l) and (l69l) can be written as 

Pc^{Ps) = / / /0(^)/(^) / f{p\cr)dpdadd (72) 

r A'o-2 

PcM"= / /«(0)/(a)/;(p,i?,2(0)|a)i?f(0)rfarf0 (73) 

where now Ri{0) is the boundary of normalized decision region corresponding to ps = 1, and 
f0{6) is as in ^3^. Observe from dZB that 

fpipW) > 0ifp<{n-2y (74) 

f;ip\a) < 0i{p>{n-2y (75) 

i.e. fiplcr) is unimodal in p with p* = {n — 2)cr^. Using these properties in (|73T ) and observing 
that djnin.i < Ri{d) < draax,i, cTi < a < 02, the integrand in (1731 ) is non-negative/non-positive if 

MLx. <(r^-2)a2 (76) 

MLn,i >('^-2)ai (77) 

so that Pct{Ps)" > or Pci(Ps)" < from which ^ and dlU follow. 
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-ARiXe) 



D. Proof of Theorem |^ 

Using (|63l)-(l66l). Pci{A) can be written as 

P,,,(A) = / feie) / f{r)drde (78) 

Jd9 Jo 

where frir) is the normalized noise amplitude density, 

^^""^ " 2«/2-ir(n/2) ^^^^ 

and -Ri(0) is the decision region boundary of the normalized {A = 1) constellation. Therefore, 

PdA)" = [ fe{0)fXAR,{e))Rl{0)de (80) 

J DO 

where 

r^'^e"^ /^(n — 1 — r^) 
/r-(^) = 2"/2-ir(n/2) 

so that the integrand in (|80l) is non-negative when ARi{0) < \Jn — 1 V0, which is case when 



^o^max.i < vri— T so that Pei(^)" < 0. The opposite case is similar. An odd number of inflection 
points follows from the continuity argument. The fact that the high/low SNR bounds cannot be 
tightened in general is clear from Corollary 16.11 

E. Proof of Theorem 

In this case, (l68l) and (|69l) become 

PciiA)= / / f{r,0)drdO (81) 

Joe Jo 

p,,(A)"=/ f^{AR,ie),e)RU9)de (82) 

Joe 
and the argument of section IVIII-BI goes thorough with the substitution 7 — )■ A, p — )■ r. 

F. Proof of Theorem \8\ 

In this case, (TTOb-dTSl) are modified to 

POO 

f{r) = / f{r\a)fia)da (83) 

Jo 
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P^A) = / / f0{O)f{a) / f{r\a)drdade (85) 

J DO Jai Jo 

r ro2 

Pc.{A)"= / fe{0)fia)f:.{AR,ie)\a)R^{e)dade (86) 

J DO Jai 

and the rest of the proof in section IVIII-CI goes through with appropriate modifications. 

G. Proof of Theorem [70l 

The SIRP noise Cartesian PDF can be expressed as: 

1 f"^ 
/(^) = ^^;^y a-''g{l,a,x)f{a)da (87) 

where 

^(7,a,x)=7-/2exp|-^| (88) 

and the SNR 7 = l/al, so that 

Pr{s, ^ s,}:; = f fix)'!^ dx (89) 

where Vlj is the decision region for Sj while the reference frame is centered on Sj. Now observe 
that 

^(7, a, a;)" = -7"^^(w^ - wi){w - W2) exp{--fw/2) (90) 

where w = \x\'^a^'^ and w^2) = {n± y/2n)/'y, so that 

g{^,cr,xy:i>Oi{w>Wi (91) 

and hence 

1 H'^ 



(92) 



from which it follows that 

Pr{si ^ s, }:; > \ft, J if <i„ > wicrl (93) 

and, from dD, BER" > under the same condition, so that (|39| ) follows, where 7 = I/ctq. 
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H. Proof of Theorem \ 

The proof follows along the same lines as that of Theorem |2l with the substitution 7 = I/ctq. 
In particular, (|66l) is modified to 



PMT = ^0' I fe{e){f;{afRm)Rm + 2a'Ma^'Rm)}dO (94) 

Jdo 

where the derivative of the noise power density fp{p) is as in (l67l) . The integrand in (|94| ) is 
non-negative when rf^axi ^ (^ + 2)cro ^^^ non-positive when rf^jnj > {n + 2)aQ from which 
(|43] ) and (l44l) follow. The inflection points follow from the continuity argument. The fact that 
the bounds cannot be improved is clear from the equal spherical decision regions of Corollary 

/. Proof of Theorem [72] 

The proof is essentially a generalized version of the previous proof. Under the stated condi- 
tions, -Pcj(co) ^^^ be written as 

Pc^{ol) = / fe{e) / /(a) / f{p\a)dpdade (95) 

Jd0 Jai Jo 

where Ri{0) is the boundary of normalized decision region corresponding to ctq = 1 and f{p\cr) 
is as in (TtTI) . so that its second derivative in ctq is 



r ro-2 

PMy = a,^ feiO) f{a){f;^{a^'R^iO)\a)Rm + 2cr'Mao'RmW)}d^d0 (96) 

Jdo Jcri 

and the integrand in (1961 ) is non-negative when li^axi ^ ("^ + 2)(cricro)^ and non-positive when 
•^min.i > ('^ + 2)((T2cro)^ from wMch the Theorem follows. 

J. Proof of Theorem [74] 

The PEP can be expressed as 

Pr|s. ^ sj = f f{x)dx (97) 

where VLj is the decision region for s^ while the reference frame is centered on Sj, and the 
AWGN density f{x) is as in (O. The second derivative in the noise power a^ is 

Pr{s,:^s,};. = I f{xr^.dx (98) 
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Fig. 5. Two-dimensional illustration of the problem geometry for the case d^i^^ > b„o-Q. The decision region Qi is shaded. 
gdccp) has a sign as indicated by "+" and "-". 



where f{x)'^2 can be expressed as 



n^y' 



CTn 



and 



271 



n/2 



exp 



g(x) = (x-6„Cro)(x 



\x\ 
2^ 



a„(jQj 



9{.\x\ 



(99) 



(100) 



where a„,6„ are as in Theorem [TT] Clearly, g(x) > if x > 6„cro or a; < a„cro, so that 



f{xy^2 > Vic G Qj if <ini > 6„(t2 or a^ag > (rfi^ + rfmaxj) 
5 and 6 illustrate these two cases. 



and the result follows. Figures 
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